Computer-aided diagnostic apparatus and method based on diagnostic intention of user

ABSTRACT

A computer-aided diagnostic (CAD) apparatus and a CAD method based on the diagnostic intention of a user are provided. The CAD apparatus includes a region of interest (ROI) detector configured to detect an ROI from an image input from a probe, and a probe motion determiner configured to determine a motion of the probe in response to the ROI detector detecting the ROI. The CAD apparatus further includes a diagnostic intention determiner configured to determine a diagnostic intention of a user based on the determined motion of the probe, and a diagnostic intention processor configured to perform a diagnostic procedure based on the determined diagnostic intention of the user.

CROSS-REFERENCE TO RELATED APPLICATION

This is a continuation application of U.S. patent application Ser. No.14/943,107, filed on Nov. 17, 2015, in the U.S. Patent and TrademarkOffice, which claims priority from Korean Patent Application No.10-2014-0169018, filed on Nov. 28, 2014, in the Korean IntellectualProperty Office, the disclosures of which are incorporated herein byreference in their entireties.

BACKGROUND 1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa computer-aided diagnostic (CAD) apparatus and a CAD method based on adiagnostic intention of a user.

2. Description of the Related Art

By using a general ultrasound diagnostic device, an examiner can detecta lesion by moving a probe over and thus scanning a suspicious area of apatient's body. A probe is a device that emits ultrasound waves directedinto the human body, and generates images from reflected ultrasoundwaves from the body that it receives. Once a lesion is detected in theimages sent by the probe, the examiner looks for an image that shows thelesion most clearly, freezes the image to inspect the lesion morecarefully, inputs diagnostic information, and then saves the inputinformation for future diagnosis. That is, when information, which isobtained in real time by moving the probe over the body of the patient,is displayed on a display screen, the examiner, such as an expert inultrasound image interpretation and diagnosis, may do a visual searchfor a lesion in a suspicious area in the displayed ultrasound images(SCAN step); freeze the screen to further inspect the area of interest(FREEZE step); measure the size and boundary of the ROI if determined tobe a lesion (MEASURE step); make an annotation about the lesion'slocation along with other information regarding the measured lesion andsave the annotation (SAVE step); unfreeze the screen to continue toscan; and repeat the aforesaid operations. As such, the examiner maymanually manipulate the CAD apparatus depending on the operation, andmay have difficulty focusing his attention.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, one ormore exemplary embodiments are not required to overcome thedisadvantages described above, and an exemplary embodiment may notovercome any of the problems described above.

According to an aspect of an exemplary embodiment, there is provided acomputer-aided diagnostic (CAD) apparatus including a region of interest(ROI) detector configured to detect an ROI from an image input from aprobe, a probe motion determiner configured to determine a motion of theprobe in response to the ROI detector detecting the ROI, a diagnosticintention determiner configured to determine a diagnostic intention of auser based on the determined motion of the probe, and a diagnosticintention processor configured to perform a diagnostic procedure basedon the determined diagnostic intention of the user.

The probe motion determiner may be configured to determine the motion ofthe probe based on consecutive images input from the probe.

The probe motion determiner may be configured to calculate a similaritybetween the input consecutive images, and determine the motion of theprobe based on the calculated similarity.

The probe motion determiner may be configured to determine the motion ofthe probe, using one or more sensors that are mounted on the probe, theone or more sensors including at least one among an acceleration sensor,a gyro sensor, and a motion sensor.

The diagnostic intention determiner may be configured to determine thediagnostic intention of the user corresponding to the determined motionof the probe that are included in intention-based classificationinformation.

The CAD apparatus may further include an intention information storageconfigured to store the intention-based classification information thatmaps motions of the probe to diagnostic intentions of the user.

The diagnostic intention of the user may be to perform one amongscanning another image with the probe, measuring the ROI, freezing ascreen, editing diagnostic information, and saving the diagnosticinformation.

The diagnostic intention processor may include an ROI measurerconfigured to measure the detected ROI in response to the determineddiagnostic intention of the user being to perform measuring the ROI, ascreen display configured to freeze the screen and display a result ofthe measuring the ROI on the frozen screen, in response to thedetermined diagnostic intention of the user being to perform freezingthe screen, and a diagnostic information storage configured to store thediagnostic information that is displayed on the screen in response tothe determined diagnostic intention of the user being to perform savingthe diagnostic information.

The screen display may be further configured to in response to thedetermined diagnostic intention of the user being to perform editing thediagnostic information, switch the screen to an edit mode, and inresponse to the determined diagnostic intention being to performscanning the other image, initialize the frozen screen and display theother image input from the probe on the initialized screen.

The motion of the probe may include at least one among being stationary,a moving motion, an editing motion, and a saving motion.

The diagnostic intention determiner may be configured to determine thatthe diagnostic intention of the user is to perform measuring the ROI inresponse to the determined motion of the probe including beingstationary during a first time unit from a moment the ROI is detected.

The diagnostic intention determiner may be configured to determine thatthe diagnostic intention of the user is to perform freezing a screen inresponse to the determined motion of the probe including beingstationary during a second time unit from a moment the ROI is measured.

The diagnostic intention determiner may be configured to in response tothe determined motion of the probe including the moving motion during athird time unit from a moment the screen is frozen, determine that thediagnostic intention of the user is to perform scanning another imagewith the probe, and in response to the determined motion of the probeincluding being stationary during the third time unit from the momentthe screen is frozen, determine that the diagnostic intention of theuser is to perform displaying a result of the measuring the ROI on thefrozen screen.

The diagnostic intention determiner may be configured to in response tothe determined motion of the probe including the editing motion duringthe third time unit from the moment the screen is frozen, determine thatthe diagnostic intention of the user is to perform editing diagnosticinformation, and in response to the determined motion of the probeincluding the saving motion during the third time unit from the momentthe screen is frozen, determine that the diagnostic intention of theuser is to perform saving the diagnostic information.

According to an aspect of another exemplary embodiment, there isprovided a computer-aided diagnostic (CAD) method including detecting aregion of interest (ROI) from an image input from a probe, determining amotion of the probe in response to the detecting the ROI, determining adiagnostic intention of a user based on the determined motion of theprobe, and performing a diagnostic procedure based on the determineddiagnostic intention of the user.

The diagnostic intention of the user may be to perform one amongscanning another image with the probe, measuring the ROI, freezing ascreen, editing diagnostic information, and saving the diagnosticinformation.

The performing the diagnostic procedure may include measuring thedetected ROI in response to the determined diagnostic intention of theuser being to perform measuring the ROI, freezing the screen anddisplaying a result of the measuring the ROI on the screen, in responseto the determined diagnostic intention of the user being to performfreezing the screen, and storing the diagnostic information that isdisplayed on the screen in response to the determined diagnosticintention of the user being to perform saving the diagnosticinformation.

The performing the diagnostic procedure may further include in responseto the determined diagnostic intention of the user being to performediting the diagnostic information, switching the screen to an editmode, and in response to the determined diagnostic intention being toperform scanning the other image, initializing the frozen screen anddisplaying the other image input from the probe on the initializedscreen.

According to an aspect of another exemplary embodiment, there isprovided a computer-aided diagnostic (CAD) apparatus including a regionof interest (ROI) detector configured to detect an ROI from an imageinput from a probe, an input signal receiver configured to receive oneor more input signals from an interface, a diagnostic intentiondeterminer configured to determine a diagnostic intention of a userbased on the received one or more input signals, and a diagnosticintention processor configured to perform a diagnostic procedure basedon the determined diagnostic intention of the user.

The diagnostic intention determiner may be configured to determine thediagnostic intention of the user based on at least one among a number,types, and combination patterns of the one or more input signals.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will be more apparent by describingexemplary embodiments with reference to the accompanying drawings, inwhich:

FIG. 1 is a block diagram illustrating a computer-aided diagnostic (CAD)apparatus, according to an exemplary embodiment;

FIG. 2 is a block diagram illustrating a CAD apparatus, according toanother exemplary embodiment;

FIG. 3 is a block diagram illustrating a diagnostic intention processorof the CAD apparatus in FIG. 2;

FIG. 4A is a table showing probe motions, according to an exemplaryembodiment;

FIG. 4B is a table showing intention-based classification informationmapping according to probe motions, according to an exemplaryembodiment;

FIG. 4C is a diagram illustrating changes in a screen according to auser's diagnostic intention, according to an exemplary embodiment;

FIG. 5 is a block diagram illustrating a CAD apparatus, according toanother exemplary embodiment;

FIG. 6 is a table showing intention-based classification according to aninput signal from a user, according to an exemplary embodiment;

FIG. 7 is a flowchart illustrating a CAD method, according to anexemplary embodiment;

FIG. 8 is a flowchart illustrating a method of performing a diagnosticprocedure based on a probe motion in the CAD method of FIG. 7;

FIG. 9 is a flowchart illustrating a CAD method, according to anotherexemplary embodiment; and

FIG. 10 is a flowchart illustrating a method of performing a diagnosticprocedure based on an input signal in the CAD method of FIG. 9.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Exemplary embodiments are described in greater detail with reference tothe accompanying drawings.

Exemplary embodiments of the present disclosure may be diverselymodified. Accordingly, exemplary embodiments are illustrated in thedrawings and are described in detail in the detailed description.However, it is to be understood that the present disclosure is notlimited to a specific exemplary embodiment, but includes allmodifications, equivalents, and substitutions without departing from thescope and spirit of the present disclosure. Also, well-known functionsor constructions may not be described in detail because they wouldobscure the disclosure with unnecessary detail.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of the exemplaryembodiments. Thus, it is apparent that the exemplary embodiments can becarried out without those specifically defined matters. Hereinafter, itis understood that expressions such as “at least one of,” when precedinga list of elements, modify the entire list of elements and do not modifythe individual elements of the list.

Hereinafter, exemplary embodiments of a computer-aided diagnostic (CAD)apparatus and a CAD method based on a user's intention for diagnosiswill be described in detail with reference to appended drawings.

The CAD apparatus according to the exemplary embodiments may be anapparatus used to classify ultrasound images obtained by a probe ormedical images obtained using various techniques, such as computedtomography (CT) or magnetic resonance imaging (MRI) techniques. Herein,for convenience of explanation, an apparatus for classifying ultrasoundimages obtained by a probe will be described.

FIG. 1 is a block diagram illustrating a CAD apparatus 100, according toan exemplary embodiment.

Referring to FIG. 1, the CAD apparatus 100 includes a region of interest(ROI) detector 110, a diagnostic intention determiner 120, and adiagnostic intention processor 130.

The ROI detector 110 receives ultrasound images. The ultrasound imagesare obtained by a probe as it scans an area of interest. The ultrasoundimages from the probe may be received in real time in units of frames.

In addition, in response to receiving the images, the ROI detector 110detects an ROI in a currently received image by applying an objectdetection algorithm thereto. Here, the ROI may be an area from the imagewhere an object of interest that a user wants to analyze is located. Theobject of interest may include, for example, a lesion or a fetus's head,fingers, and toes, but is not limited thereto. In this example, the ROIindicates an area suspected of containing a lesion. The object detectionalgorithm may be, for example, AdaBoost, Deformable Part Models (DPM), adeep neural network (DNN), a convolutional neural network (CNN), orspare coding, and is not limited thereto. One or more algorithms may beapplied by taking into consideration the capabilities of the CADapparatus 100, purpose of diagnosis, diagnostic time period, or thelike.

When an ROI is not detected in the current image, the ROI detector 110may receive a subsequent image from the probe and repeat the ROIdetection process in the subsequently received image.

If an ROI is detected in the subsequently received image, the diagnosticintention determiner 120 responds by inferring the user's diagnosticintention regarding the diagnostic procedures the user wishes to carryout on the detected ROI.

For example, the diagnostic intention determiner 120 may determine thediagnostic intention based on a motion of the probe or a user inputsignal received through a connected interface. In addition, thediagnostic intention determiner 120 may determine the user's diagnosticintention using various methods, such as detecting eye movement or gazedirection.

Here, the user's diagnostic intention may indicate various actionsincluding scanning a suspicious area using a probe, measuring a detectedROI, freezing a displayed screen, editing diagnostic information, andsaving the diagnostic information. However, the diagnostic intention isnot limited thereto, such that the diagnostic intention may include onlysome of the aforementioned actions or add other actions (e.g., the typeof diagnosed disease, the purpose of diagnosis, and the user'sproficiency and experience) according to the computing performance ofthe CAD apparatus 100. For example, the screen freeze operation may beomitted or simplified; or the ROI measurement operation may be brokendown into a number of procedures such as ROI size measurement, featureextraction, and a malignancy/benignity classification.

The diagnostic intention processor 130 performs diagnostic proceduresthat correspond to the determined diagnostic intention of the user.

For example, if the determined diagnostic intention is to measure theROI, feature information about the detected ROI is extracted, and thenclassification on whether it is malignant or benign is carried out usingthe extracted feature information. In addition, if the user's diagnosticintention is to freeze the displayed screen, the current displayedscreen is frozen, and a measurement result of the ROI may be displayedon the current screen. Furthermore, if the determined diagnosticintention is to save diagnostic information, then the action isperformed; if the diagnostic intention is to edit the diagnosticinformation, then the current screen may be switched to edit mode; ifthe determined diagnostic intention of the user is to scan an image, thecurrent screen is initialized, and a subsequent image input from theprobe may be output onto the screen.

FIG. 2 is a block diagram illustrating a CAD apparatus 200, according toanother exemplary embodiment.

Referring to FIG. 2, the CAD apparatus 200 includes an ROI detector 210,a diagnostic intention determiner 220, a diagnostic intention processor230, a probe motion determiner 240, and an intention information storage250.

The ROI detector 210 receives an image input from a probe, and examinesit for any ROI that may be present. The ROI detector 210 may detect anROI using any appropriate object detection algorithm as described above.When no ROI is detected from the current image, the ROI detector 210 mayiteratively receive an image and examine it for any ROI.

When an ROI is detected, the probe motion determiner 240 determines amotion of the probe, based on the diagnostic intention of the user thatis determined. The motion of the probe may be defined as ‘Turn (aturning motion),’ ‘Push (a saving motion),’ ‘LR Shake (an editingmotion),’ ‘FB Shake (a zooming motion),’ ‘Stay (being stationary),’ and‘Move (moving),’ but some may be omitted or other motions may be added.

In an exemplary embodiment, the probe motion determiner 240 maydetermine the motion of a probe by analyzing consecutive images from theprobe. By analyzing any locational changes of a feature acrossconsecutively input images, the probe motion determiner is able todetermine whether the probe is stationary or in motion, and if the probeis indeed determined as being in motion, the probe motion determiner 240determines the direction and speed in which the probe is moving. In suchcases, the degree of similarity among consecutive images is calculated,and if the obtained degree is greater than a threshold (e.g., 95%), theprobe motion determiner 240 may determine that the probe is instationary. In this regard, as the probe motion may vary according tothe user, the threshold may be set differently for each user.

In another exemplary embodiment, the probe motion determiner 240 may usesensors installed inside the probe (e.g., an acceleration sensor, a gyrosensor, and motion sensor, etc.) to determine whether the probe isstationary or in motion, and, if in motion, determine its direction andspeed. In addition, an image capturing device, such as a motion cameraor a depth camera, is installed at a location inside the CAD apparatus200 to capture the probe motion, and the probe motion determiner 240 maydetermine the probe motion by analyzing input images from the imagecapturing device. To avoid performance degradation, the probe motiondeterminer 240 may determine the probe motion only after an ROI has beendetected in a current image.

The diagnostic intention determiner 220 determines what the user'sdiagnostic intention is based on any probe motion that is registered inthe current diagnostic state. The diagnostic intention determiner 220 isable to collect information regarding the operational state of the CADapparatus 200 and then determine the current diagnostic state of the CADapparatus. For example, the diagnostic intention determiner 220 maydetermine whether the probe is obtaining ultrasound images and thusimage scanning is in progress, whether an ROI has been detected by anobject detection algorithm, whether the ROI has been measured, orwhether the screen is in a freeze state.

In addition, when probe motion is determined to correspond to adiagnostic intention, the diagnostic intention determiner 220 maydetermine the user's diagnostic intention as being the diagnosticintention that matches the intention-based classification informationstored in the intention information storage 250. The intention-basedclassification information maps probe motions that have been matched tothe user's diagnostic intentions and may be stored beforehand in variousforms, such as a table, ontologies, logical formulas, etc.

The diagnostic intention processor 230 performs diagnostic procedurescorresponding to the determined diagnostic intention of the user.

FIG. 3 is a block diagram illustrating the diagnostic intentionprocessor 230 of the CAD apparatus in FIG. 2. Referring to FIG. 3, thediagnostic intention processor 230 includes an ROI measurer 310, ascreen display 320, and a diagnostic information storage 330.

When the user's diagnostic intention is determined, based on the probemotion, as an ROI is being measured, then the ROI measurer 310 measuresthe ROI, whereby such measuring action is a part of the diagnosticprocess. Measurement of ROI may be performed in the background.

The ROI measurer 310 may measure the size of detected ROI, extractinformation regarding any features of the ROI, classify the ROI as beingeither malignant or benign using the extracted feature information,after which the ROI measurer 310 may finally generate ROI measurementinformation.

The feature information may contain data regarding the features of alesion, such as its shape, echo pattern, orientation, boundary, texture,and intensity; the information may also contain characteristics of thelesion that are in accordance with lexicon classifications (BreastImaging and Data System (BI-RADS) or Liver Imaging Reporting and DataSystem (LI-RADS)). So for example, an ROI measurement result generatedmay show a lesion as having an oval shape with a 15 mm major axis and 5mm minor axis, and an inclination of 45 degree; the informationregarding the characteristics of the lesion may also be shown, such asan irregular boundary, shadowing, and a 45% probability of being benign.

The screen display 320 outputs a current image that is being receivedfrom the probe to the display screen. In addition, when an ROI isdetected from the current image, the screen display 320 may visuallyindicate the ROI, in the current image, using information about the ROI(e.g., location and size of the ROI). For example, the screen display320 may make a visual indication of the ROI at its position in thecurrent image with colored markers (e.g. bounding box, circle, ellipse,cross) or by adjusting the style and thickness of the lines so that theROI can be visually recognized.

In addition, upon commencement of ROI measurement, if it is determinedthat the user's diagnostic intention is to freeze the screen, then thescreen display 320 may freeze the current screen image and output, tothe display screen, diagnostic information that contains the measurementinformation of ROI.

Moreover, if the diagnostic information that contains the ROI'smeasurement information is output to the current screen and then it isdetermined that the user's diagnostic intention is to edit thediagnostic information, the screen display 320 may switch the currentscreen to edit mode, thus allowing the user to make any changes to thediagnostic information.

In this case, the user may edit the diagnostic information by utilizingvarious input interfaces mounted on the CAD apparatus 200, such as akeyboard, a touch panel, a mouse or a probe, wherein the diagnosticinformation may include, for example, the location, size, andmeasurement information of the ROI. To enable the user the use of bothhands during the diagnostic process, such as manipulation of a probe,the CAD apparatus 200 may feature speech recognition technology,allowing the user to edit the diagnostic information by speech. Thereare a variety of well-known voice recognition technologies that can beutilized, and thus descriptions thereof will be omitted.

Further, if it is determined that the user's diagnostic intention isimage scanning by which a new image is input, the screen display 320 mayinitialize the current screen and output a subsequent input image fromthe probe to the display.

If the measurement of ROI is complete and then it is determined that theuser's diagnostic intention is to save the diagnostic information, thediagnostic information storage 330 saves the information that containsthe image and measurement information which are currently beingdisplayed on screen.

FIG. 4A is a table showing probe motions, according to an exemplaryembodiment. FIG. 4B is a table showing intention-based classificationinformation mapping according to probe motions, according to anexemplary embodiment. FIG. 4C is a diagram illustrating changes in ascreen according to a user's diagnostic intention, according to anexemplary embodiment.

The diagnostic procedures based on a user's diagnostic intention will bedescribed with reference to FIG. 2 and FIGS. 4A to 4C.

As shown in FIG. 4A, motions of a probe may be initially defined asturning, editing motion, zooming, being stationary, and moving, but aprobe's motions are not limited thereto. The probe's motions may be setto match user's manipulations of the probe or probe states, for example,‘Turn (a turning motion),’ ‘Push (a saving motion),’ ‘LR Shake (anediting motion),’ ‘FB Shake (a zooming motion),’ ‘Stay (beingstationary),’ and ‘Move (moving),’ and the like.

FIG. 4B is a table showing an example of intention-based classificationinformation stored in the intention information storage 250, whereintention-based classification information is defined by mapping probemotions that have been matched to the user's diagnostic intentions. Inthis case, as shown in the table, the intention-based classificationinformation may be defined by mapping each probe motion that has beenmatched to a user's diagnostic intention for each diagnostic state. Thediagnostic states may be classified into one or more sub-statesdepending on the diagnostic procedure, such as detection of ROI, displayof ROI, measurement of ROI, screen freezing, display of diagnostic ormeasurement information, and image scanning. However, as describedabove, some of the aforementioned procedures may be omitted or newprocedures may be added thereto, and thus the diagnostic states may bedefined differently.

Referring back to FIGS. 2 and 4B, the probe motion determiner 240continuously determines the motions of the probe after an ROI has beendetected from a current image.

From the moment the detected ROI is displayed on the screen, thediagnostic intention determiner 220 registers all probe motions thathave been occurred during a time frame (e.g., 2 seconds), which may bereferred to as the first time unit. If the probe has remain stationary,lingering on the ROI during the time frame, the diagnostic intentiondeterminer 220 may determine that the user's diagnostic intention is tomeasure the ROI with reference to the intention-based classificationinformation.

The diagnostic intention processor 230 may measure the ROI according tothe user's diagnostic intention and then create measurement information,such as information regarding the ROI's features and classification ofmalignancy or benignity.

If the user has moved the probe before the end of the first time unit,the diagnostic intention determiner 220 may determine that the user'sdiagnostic intention is to scan the image.

In response its determination that the user's diagnostic intention is toscan an image, the diagnostic intention processor 230 may initialize thecurrent screen and output new images that are fed to the screen inreal-time as the probe moves.

In addition, from the moment the ROI measurement procedure has started,the diagnostic intention determiner 220 registers all probe motions thatoccur during another time frame (e.g., 2 seconds), which may be referredto as a second time unit. If the probe has remained stationary duringthe second time unit, the diagnostic intention determiner 220 maydetermine that the user's diagnostic intention is to freeze the screen,and may thus display diagnostic information to observe in detail theROI.

Accordingly, the diagnostic intention processor 230 may freeze thescreen and output to the screen the diagnostic information that containsthe measurement information about the measured ROI.

At this time, the second time unit may be divided into two intervals andthe user's intention during each interval is determined as eitherfreezing the screen or displaying diagnostic information according tothe probe motion that occurs during the interval. If the screen isfrozen according to the user's diagnostic intention determined duringthe first interval (e.g., 1 second) and thereafter the probe's motionduring the following interval (e.g., 1 second) is determined as one ofmoving or saving, it is accordingly determined that the diagnosticintention of a user is to scan the image or save diagnostic information.

At this time, the diagnostic intention processor 230 may eitherinitialize the current screen or immediately save the diagnosticinformation depending on the user's diagnostic intention withoutoutputting the diagnostic information to the screen in a freeze state.

If measuring the ROI takes a longer amount of time that that afforded inthe first and second time units, only some features of the ROI that canbe measured before the end of the second time unit, say, the size of theROI, is measured, and then the measurement result is displayed. Theother measurements of the ROI may be performed while the screen is in afreeze state, and the measurement results are sequentially displayed onthe screen.

In addition, if, while the diagnostic information is being displayed onthe screen, the probe has remained stationary during a third time unit(e.g., 1 second), the diagnostic intention determiner 220 may determinethat the user's diagnostic intention is to automatically save thediagnostic information. In addition, if the user pushes the probeorthogonally during the third time unit, the diagnostic intentiondeterminer 220 may determine that the probe's motion is one of savingas, and that the user's diagnostic intention is to manually save thediagnostic information.

At this time, the diagnostic intention processor 230 stores diagnosticinformation according to the user's diagnostic intention, and mayfurther store information as to whether the diagnostic information isautomatically or manually saved.

In addition, when it is determined that the diagnostic information is tobe edited while being displayed on the screen, the user can shake theprobe left and right before the end of the third time unit, so that theprobe motion can be determined as an editing motion. Then, thediagnostic intention determiner 220 determines that the diagnosticintention of the user is to edit the diagnostic information, to whichthe diagnostic intention processor 230 switches the current screen toedit mode according to the user's diagnostic intention.

The user may enable the probe motion to be determined as a moving motionin each diagnostic state by moving the probe at any time before eachunit time has elapsed. Consequently, the diagnostic intention determiner220 may determine that the diagnostic intention of the user is to scanan image, and the diagnostic intention processor 230 may initialize thecurrent screen and output a new input image to the screen.

Here, the first time unit, the second time unit, and the third time unitmay be appropriately set according to the performance, purpose ofdiagnosis, type of disease being targeted, and the proficiency of theuser with regard to using the CAD apparatus. For example, a computerwith low performance takes a relatively longer period of time to measurethe ROI, and hence the second time unit, whose length is measured themoment ROI measurement starts, may be set to have a long time frame inproportion to the time taken for the ROI measurement. A user withlimited proficiency may take a substantial amount of time to analyze animage and diagnostic information displayed on the screen, and thus thethird time unit may be set to be relatively long, during which whetherto save or edit the diagnostic information is determined.

FIG. 4C shows, starting from the illustration on the far left, changesin the screen according to the user's diagnostic intention from themoment an image is received to the moment the diagnostic information issaved.

Referring to FIG. 4C, an image received from a probe 41 that the user ismoving is output to the screen, and an ROI is detected, as seen in theillustration on the far left.

Thereafter, a bounding box 42 that indicates a detected ROI may beoutput to the screen. If the user does not move the probe 41 for 2 ormore seconds because of the detection of the ROI, the ROI measurementprocedure may start, as seen in the second illustration from the left.

If the user does not move the probe for 1 or more seconds after theprocedure, measurement information 43 may be displayed at the bottom ofthe screen, as seen in the third illustration from the left.

Then, when the user pushes the probe 41 with an intention to save thediagnostic information, the diagnostic information 42 and 43 on thecurrent screen is saved, to which the message “SAVED” may be output atthe top of the screen, as seen in the illustration on the far right.

FIG. 5 is a block diagram illustrating a CAD apparatus 500, according toanother exemplary embodiment. FIG. 6 is a table showing intention-basedclassification according to an input signal from a user, according to anexemplary embodiment.

Referring to FIG. 5, the CAD apparatus 500 includes an ROI detector 510,a diagnostic intention determiner 520, a diagnostic intention processor530, an input signal receiver 540, and an intention information storage550.

The CAD apparatus 500 of FIG. 5 is another example of the CADapparatuses 100 and 200 of FIGS. 1 and 2, and it will be construed thatcomponents with the same name perform substantially the same function.Therefore, hereinafter, descriptions will be provided with focus onfunctions that have not been redundantly described.

As described above, the ROI detector 510 receives an image from a probe,and detects an ROI from the currently received image by applying anobject detection algorithm.

The input signal receiver 540 receives a user's input signal via aninterface. The interface may be, for example, a switch, a button, atrackball, a jog shuttle, a joystick, or the like, which is connected tothe CAD apparatus 500, allowing the user to manipulate the CAD apparatus500 using a his or her body part that is not already engaged inmanipulating the probe. In addition, the interface may include awearable signal generating device in the form of a headband or glasses.

The diagnostic intention determiner 530 determines the diagnosticintention of the user based on the user's input signals, the number ofinput signals per time unit, types of input signals, a pattern bycombining the two, etc., which the input signal receiver 540 hasreceived.

In addition, the diagnostic intention determiner 530 may determine theuser's diagnostic intention according to the input signal by utilizingthe intention-based classification information stored in the intentioninformation storage 550.

The intention-based classification information is information that mapsthe user's diagnostic intention with at least one of the following: thepredefined number of input signals, type of input signals, and acombination pattern, and it may be stored in various forms, such astables, logic formulas, or complex ontologies.

The intention-based classification information may be information thatmaps diagnostic intentions with a variety of signals that are generatedas any interface, for example, a jog shuttle or a joystick, ismanipulated. For example, a forward push signal, a backward push signal,a left push signal, and a right push signal of a jog shuttle may bemapped with measuring of ROI, screen freezing, saving of diagnosticinformation, and editing of diagnostic information, respectively, and ashake signal may be mapped with image scanning in which the screen isinitialized and a new image is received.

In another example, as shown in FIG. 6, the intention-basedclassification information may be information that maps the diagnosticintention with the number of input signals being input during a timeunit, regardless of the type of an interface.

In yet another example, the intention-based classification informationmay be information generated by mapping the diagnostic intentions thathave been matched to patterns by combining signals input from two ormore interfaces, such as a jog shutter (controlled with the left hand)and a switch (controlled with the left foot), patterns by combiningtypes of two or more interfaces, the number of signals input during atime unit, and the like. For example, a switch signal input afterdetection of the ROI may be matched to the ROI measurement, and eachcontrol signal for the jog shuttle after measurement of the ROI may bematched to screen freezing, saving of diagnostic information, editing ofdiagnostic information, and image scanning.

The diagnostic intention processor 530 performs a diagnostic procedurethat corresponds to the user's diagnostic intention, which wasdetermined based on the input signal from the user and with reference tothe intention-based classification information, as described above.

FIG. 6 is a diagram illustrating a table showing intention-basedclassification information that indicates diagnostic intentions of auser, which have been defined according to the number of input signalsof each diagnostic state.

An exemplary embodiment of determining a user's diagnostic intentionbased on the number of input signals from an input device will bedescribed with reference to FIG. 6.

If a single input signal is received during a time unit via an inputdevice while the detected ROI is displayed on screen, the diagnosticintention determiner 520 may determine that the user's diagnosticintention is to measure the detected ROI. At this time, the ROImeasurement procedure may be broken down into several stages, such asmeasurement of a size of ROI, extraction of feature information, andmalignancy/benignity classification, and the like.

If the diagnostic intention determiner 520 receives no input signal orreceives three input signals from the user during a time unit, thediagnostic intention determiner 520 may determine that the user'sdiagnostic intention is image scanning, by which the current screen isinitialized and the next input image is received.

In addition, if the diagnostic intention determiner 520 receives asingle input signal from the input device during the time unit while thediagnostic information that contains the ROI measurement information isbeing displayed on the screen, the diagnostic intention determiner 520may determine that the user's diagnostic intention is to edit thediagnostic information.

Further, if the diagnostic intention determiner 520 receives twoconsecutive input signals during the time unit while the diagnosticinformation displayed on the screen is in edit mode, the diagnosticintention determiner 520 may determine that the user's diagnosticintention is to save the diagnostic information.

In addition, once the user considers the observance of the current ROIto be pointless, the user may input three consecutive input signalswithin the time unit, and thereby the current screen is initialized andthe user can receive a new input image from the probe.

At this time, the time unit may be set differently according to theperformance of the CAD apparatus 230, the purpose of diagnosis, the typeof disease being targeted, and the proficiency of the user with regardto using the CAD apparatus. In addition, the time unit may be setdifferently according to diagnostic state.

FIG. 7 is a flowchart illustrating a CAD method, according to anexemplary embodiment.

FIG. 7 is an example of the CAD method performed by the CAD apparatus200 of FIG. 2 based on a probe motion.

In operation 711, the CAD apparatus 200 receives an image from a probe.

In operation 712, the CAD apparatus 200 detects or scans for an ROI fromthe received current image. At this time, the CAD apparatus 200 may scanfor the ROI by applying any of the various object detection algorithmsto the current image that are suitable to the computing performance ofthe CAD apparatus 200. Examples of the object detection algorithms mayinclude AdaBoost, a DPM, a DNN, a CNN, and spare coding.

In operation 713, the CAD apparatus 200 determines whether an ROI isdetected from the received current image. If the CAD apparatus 200 failsto detect an ROI from the received current image, the CAD apparatus 200returns to operation 711, in which the CAD apparatus 200 receivesanother image from the probe. If the CAD apparatus 200 successfullydetects an ROI from the newly-received current image, the CAD apparatus200 continues in operation 714.

In operation 714, the CAD apparatus 200 determines the motion of theprobe. For example, the CAD apparatus 200 may calculate the similarityamong the consecutive images, and determine the motion of the probebased on the calculated similarity. If the calculated similarity isgreater than a threshold, the probe motion may be determined as beingstationary. Otherwise, the probe motion may be determined as moving.

In another example, data about an operational state, referred to asoperational data, of the probe may be collected from various sensorsmounted on the probe, such as an acceleration sensor, a gyro sensor, anda motion sensor, and the probe motion can be determined based on thecollected operational data. Alternatively, the probe motion may bedetermined using various methods, e.g., analysis of images captured ofthe movement of the probe.

In operation 715, the CAD apparatus 200 determines the diagnosticintention of the user based on the determined probe motion. The user'sdiagnostic intention may include scanning an image, measuring a detectedROI, freezing a screen, editing diagnostic information, and saving thediagnostic information, and may exclude some of the aforementionedactions or add other actions according to various conditions, such asthe computing performance of the CAD apparatus 200, the purpose ofdiagnosis, the target of diagnosis, and the user's proficiency andexperience. As described above, when the diagnostic intentioncorresponds to a probe motion that is determined with reference to theintention-based classification information, the diagnostic intention isdetermined as the user's diagnostic intention, where the intention-basedclassification information contains mapping information of probe motionsmatched to diagnostic intentions.

In operation 716, the CAD apparatus 200 performs a diagnostic procedurethat corresponds to the determined user's diagnostic intention. Forexample, if the user's intention is to measure an ROI because the ROIhas been determined to be a lesion, then features of the detected lesionare extracted and a malignancy/benignity classification is performed. Ifthe user's diagnostic intention is to freeze the screen, then thecurrent screen is frozen and the measurement result is displayedthereon. Additionally, if the user's diagnostic intention is to save thediagnostic information, the diagnostic information displayed on thecurrent screen is saved; if the diagnostic intention is to edit thediagnostic information, the current screen is switched to edit mode; ifthe diagnostic intention is to scan an image, the current screen isinitialized and the next input image from the probe is displayed on thescreen.

FIG. 8 is a flowchart illustrating a method of performing a diagnosticprocedure based on a probe motion in the CAD method of FIG. 7. Operation720 will be described in detail with reference to FIG. 8.

First, if an ROI is detected in operation 713 of FIG. 7, in operation801, the CAD apparatus 200 displays the detected ROI by marking thedetected ROI on the current image on the screen. At this time, by usingposition or size information of the detected ROI, a visible mark, forexample, a bounding box or an oval, or circle mark may be output toindicate the detected ROI.

In operation 802, the CAD apparatus 200 determines whether the probe hasbeen stationary for 2 seconds or more from the moment the ROI wasdetected. If the CAD apparatus 200 determines that the probe has beenstationary for 2 seconds or more, the CAD apparatus 200 determines thatthe user's diagnostic intention is to measure the ROI, and the CADapparatus 200 continues in operation 803. If the CAD apparatus 200determines that the user moves the probe during the 2 seconds, the CADapparatus 200 determines that the probe motion is a moving motion andthat the user's diagnostic intention is to continuously scan an examinedarea, and the CAD apparatus 200 returns to operation 711 of FIG. 7.

In operation 803, the CAD apparatus 200 measures the detected ROIcorresponding to the user's diagnostic intention.

In operation 804, the CAD apparatus 200 determines whether the probe hasbeen stationary for 1 second or more from the moment the ROI measurementstarted. If the CAD apparatus 200 determines that the probe has beenstationary for 1 second more, the CAD apparatus 200 determines that theuser's diagnostic intention is to freeze the screen to observe both thecurrent image and the measurement result of the ROI, and the CADapparatus 200 continues in operation 805. If the CAD apparatus 200determines that the user moves the probe during the 1 second, the CADapparatus 200 determines that the user is not interested in the currentROI any longer, and the CAD apparatus 200 returns to operation 711.

In operation 805, the CAD apparatus 200 freezes the current screen.

In operation 806, the CAD apparatus 200 determines whether the probe hasbeen stationary for 1 second or more from the moment the screen wasfrozen. If the CAD apparatus 200 determines that the probe has beenstationary for 1 second more, the CAD apparatus 200 determines that theuser's diagnostic intention is to display diagnostic information forfurther analysis of the diagnostic information, and the CAD apparatus200 continues in operation 807. If the CAD apparatus 200 determines thatthe user moves the probe during the 1 second, the CAD apparatus 200determines that the user's diagnostic intention is to scan an image, andthe CAD apparatus 200 returns to operation 711.

In operation 807, the CAD apparatus 200 displays the diagnosticinformation that contains the ROI measurement result.

Operations 804 to 807 may be combined into two steps: for example, astep in which it is determined whether a probe is stationary for 2seconds from the moment the ROI measurement started, and a step inwhich, if the probe motion is stationary for the 2 seconds, the currentscreen is frozen and the diagnostic information is output.

In operation 808, the CAD apparatus 200 determines whether the probemotion is an editing motion such as a left-right shake. If the CADapparatus 200 determines that the probe motion is an editing motion, theCAD apparatus 200 determines that the user's diagnostic intention is toedit diagnostic information, and the CAD apparatus 200 continues inoperation 809. Otherwise, the CAD apparatus 200 continues in operation810.

In operation 809, the CAD apparatus 200 switches the current screen toan edit mode.

In operation 810, that the CAD apparatus 200 determines whether theprobe has been stationary for 1 second or more after the diagnosticinformation was displayed or the screen was switched to the edit mode,or whether the probe motion is a saving motion or pushing motion evenbefore the 1 second has elapsed. If the CAD apparatus 200 determinesthat the probe has been stationary for 1 second or more, or that theprobe motion is a pushing motion, the CAD apparatus 200 determines thatthe user's diagnostic intention is to save diagnostic information, andthe CAD apparatus 200 continues in operation 811. If the CAD apparatus200 determines that the user moves the probe during the 1 second, orthat the probe motion is not a pushing motion, the CAD apparatus 200determines that the user's diagnostic intention is to scan an image, andthe CAD apparatus 200 returns to operation 711.

In operation 811, the CAD apparatus 200 saves the diagnostic informationthat contains the current image, the ROI information, and/or themeasurement result of the ROI.

In operation 812, the CAD apparatus 200 determines whether diagnosis hasbeen completed, e.g., whether the user turns off the CAD apparatus 200or performs a probe motion. If the CAD apparatus 200 determines that thediagnosis has been completed, the CAD apparatus 200 also determines thatthe user's diagnostic intention is to finish the diagnostic process, andaccordingly, the diagnosis is terminated. Otherwise, the CAD apparatus200 returns to operation 711.

FIG. 9 is a flowchart illustrating a CAD method, according to anotherexemplary embodiment.

FIG. 9 shows an exemplary embodiment of a diagnostic method performed bythe CAD apparatus 500 of FIG. 5 based on an input signal.

In operation 911, the CAD apparatus 500 receives an image from a probe.

In operation 912, the CAD apparatus 500 detects or scans for an ROI fromthe received current image. At this time, the ROI may be scanned for byapplying to the current image any of the various object detectionalgorithms suitable to computing performance of the CAD apparatus 500.

In operation 913, the CAD apparatus 500 determines whether an ROI isdetected from the received current image. If the CAD apparatus 500determines that an ROI is not detected, the CAD apparatus 500 returns tooperation 911 in which the CAD apparatus 500 receives another image fromthe probe. If the CAD apparatus 500 determines that an ROI is detected,the CAD apparatus 500 continues in operation 914.

In operation 914, the CAD apparatus 500 receives a user's input signal.

In operation 915, the CAD apparatus 500 determines the diagnosticintention of the user based on the user's input signal. At this time, asdescribed above, the user's diagnostic intention may be determined withreference to intention-based classification information that containsdiagnostic intentions matched to at least one of the following: thenumber, type, and combination patterns of the input signals from eachinput device.

In operation 916, the CAD apparatus 500 performs a diagnostic procedurethat corresponds to the determined diagnostic intention of the user.

FIG. 10 is a flowchart illustrating a method of performing a diagnosticprocedure based on an input signal in the CAD method of FIG. 9.Operation 920 will be described in detail with reference to FIG. 10.

Referring to FIG. 10, if an ROI is detected in operation 913 of FIG. 9,in operation 1001, the CAD apparatus 500 displays the detected ROI bymarking the detected ROI on the current image on the screen. At thistime, a colored visible mark (e.g., a bounding box, an oval, or acircle) may be output based on the location or size information of thedetected ROI to indicate the detected ROI.

In operation 1002, the CAD apparatus 500 determines whether a singleinput signal is received within one time unit after the ROI is detected.If the CAD apparatus 500 determines that the input signal is receivedwithin the one time unit, the CAD apparatus 500 determines that theuser's diagnostic intention is to measure the ROI, and the CAD apparatus500 continues in operation 1003. If the CAD apparatus 500 determinesthat the input signal is not received within the one time unit, or thatone or more input signals are received consecutively three times withinthe one time unit, the CAD apparatus 500 determines that the user'sdiagnostic intention is to scan an image, and the CAD apparatus 500returns to operation 911 of FIG. 9.

In operation 1003, the CAD apparatus 500 performs the ROI measurementprocedure, and displays the diagnostic information that contains themeasurement result of the ROI on the screen.

In operation 1004, the CAD apparatus 500 determines whether one or moreinput signals are received only one time within a time unit after theROI is displayed. If the CAD apparatus 500 determines that one or moreinput signals are received only one time within a time unit, the CADapparatus 500 determines that the user's diagnostic intention is to editthe diagnostic information, and the CAD apparatus 500 continues inoperation 1005. Otherwise, the CAD apparatus 500 continues in operation1006.

In operation 1005, the CAD apparatus 500 switches the current screen toan edit mode.

In operation 1006, the CAD apparatus 500 determines whether one or moreinput signals are consecutively received two times within a time unitafter the ROI is displayed or after the screen is switched to the editmode. If the CAD apparatus 500 determines that one or more input signalsare consecutively received two times within a time unit, the CADapparatus 500 determines that the user's diagnostic intention is to savethe diagnostic information, and the CAD apparatus 500 continues inoperation 1008. Otherwise, the CAD apparatus 500 continues in operation1007.

In operation 1008, the CAD apparatus 500 saves the diagnosticinformation displayed on the current screen.

In operation 1007, the CAD apparatus 500 determines whether one or moreinput signals are consecutively received three times within a time unit.If the CAD apparatus 500 determines that one or more input signals areconsecutively received three times within a time unit, the CAD apparatus500 determines that the user's diagnostic intention is to scan an image,and the CAD apparatus 500 returns to operation 911. Otherwise, the CADapparatus 500 continues in operation 1009.

In operation 1009, the CAD apparatus 500 determines whether diagnosis iscompleted, e.g., whether the user turns off the CAD apparatus 500 orperforms a probe motion. If the CAD apparatus 500 determines that thediagnosis is completed, the CAD apparatus 500 also determines that theuser's diagnostic intention is to finish the diagnostic process, and sothe diagnosis is terminated. Otherwise, the CAD apparatus 500 returns tooperation 911 to repeat the subsequent operations.

While not restricted thereto, an exemplary embodiment can be embodied ascomputer-readable code on a computer-readable recording medium. Forexample, a control program that controls the above-described operationsof the multi-view display device 100 or 200 may be embodied ascomputer-readable code on a computer-readable recording medium. Thecomputer-readable recording medium is any data storage device that canstore data that can be thereafter read by a computer system. Examples ofthe computer-readable recording medium include read-only memory (ROM),random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, andoptical data storage devices. The computer-readable recording medium canalso be distributed over network-coupled computer systems so that thecomputer-readable code is stored and executed in a distributed fashion.Also, an exemplary embodiment may be written as a computer programtransmitted over a computer-readable transmission medium, such as acarrier wave, and received and implemented in general-use orspecial-purpose digital computers that execute the programs. Moreover,it is understood that in exemplary embodiments, one or more units of theabove-described apparatuses 100, 200 can include circuitry, a processor,a microprocessor, etc., and may execute a computer program stored in acomputer-readable medium.

The foregoing exemplary embodiments and advantages are examples and arenot to be construed as limiting. The present teaching can be readilyapplied to other types of apparatuses. Also, the description ofexemplary embodiments is intended to be illustrative, and not to limitthe scope of the claims, and many alternatives, modifications, andvariations will be apparent to those skilled in the art.

What is claimed is:
 1. An ultrasound diagnostic apparatus comprising: aprobe configured to acquire ultrasound signals from an object; a displayconfigured to display an ultrasound image; a memory configured to storeinstructions; and a processor configured to execute the storedinstructions to: generate a plurality of ultrasound images, based on theacquired ultrasound signals; determine a motion of the probe, based onchanges across the generated plurality of ultrasound images; and performa first function corresponding to the determined motion of the probe,and a diagnostic state, among a plurality of functions that are providedby the ultrasound diagnostic apparatus, based on mapping informationthat maps a plurality of motions of the probe and a plurality ofdiagnostic states to the plurality of functions, wherein the mappinginformation is pre-stored in the memory, wherein the plurality motionsof the probe comprises any combination of pushing, shaking, staying,moving, and turning, wherein the plurality of diagnostic statescomprises any combination of detection of ROI, display of ROI,measurement of ROI, screen freezing, display of diagnostic ormeasurement information, and image scanning, and wherein the pluralityof functions comprises any combination of a freezing function forfreezing the displayed ultrasound image, an unfreezing function forunfreezing the ultrasound image, and a saving function for saving thedisplayed ultrasound image.
 2. The ultrasound diagnostic apparatus ofclaim 1, wherein the processor is further configured to execute thestored instructions to: determine whether the probe is stationary ormoving, based on the determined motion of the probe; and based on theprobe being determined to be moving, determine either one or both of amoving direction and a speed of the probe.
 3. The ultrasound diagnosticapparatus of claim 1, wherein the processor is further configured toexecute the stored instructions to: determine a similarity between thegenerated plurality of ultrasound images; and determine the motion ofthe probe, based on the determined similarity.
 4. The ultrasounddiagnostic apparatus of claim 1, wherein the processor is furtherconfigured to execute the stored instructions to: based on the motion ofthe probe being determined to correspond to the unfreezing function,control the display to display a new ultrasound image that is generatedby the processor; and based on the motion of the probe being determinedto correspond to the freezing function, control the display to freezethe displayed ultrasound image; and based on the motion of the probebeing determined to correspond to the saving function, save, in thememory, the displayed ultrasound image.
 5. The ultrasound diagnosticapparatus of claim 1, wherein the saving function is determined based ona pushing motion of the probe, and wherein the unfreezing function isdetermined based on a moving motion, during a state in which theultrasound image is frozen.
 6. The ultrasound diagnostic apparatus ofclaim 1, wherein the processor is further configured to execute thestored instructions to control the display to display measurementinformation of the frozen ultrasound, on the frozen ultrasound image. 7.The ultrasound diagnostic apparatus of claim 1, wherein the processor isfurther configured to execute the stored instructions that are stored:detect a number of input signals during a time unit; and perform asecond function, based on the number of input signals detected duringthe time unit.
 8. A non-transitory computer-readable medium comprisinginstructions executable by a processor to cause the processor to:control a display to display an ultrasound image; determine a motion ofa probe, based on changes across a plurality of ultrasound images thatis generated based on ultrasound signals that are acquired by the probefrom an object; and perform a first function corresponding to thedetermined motion of the probe, and a diagnostic state, among aplurality of functions that are provided by an ultrasound diagnosticapparatus, based on mapping information that maps a plurality of motionsof the probe and a plurality of diagnostic states to the plurality offunctions, wherein the mapping information is pre-stored in a memory,wherein the plurality motions of the probe comprises any combination ofpushing, shaking, staying, moving, and turning, wherein the plurality ofdiagnostic states comprises any combination of detection of ROI, displayof ROI, measurement of ROI, screen freezing, display of diagnostic ormeasurement information, and image scanning, and wherein the pluralityof functions comprises any combination of a freezing function forfreezing the displayed ultrasound image, an unfreezing function forunfreezing the frozen ultrasound image, and a saving function for savingthe displayed ultrasound.
 9. The non-transitory computer-readable mediumof claim 8, wherein the instructions are further executable by theprocessor to cause the processor to: determine whether the probe isstationary or moving, based on the determined motion of the probe; andbased on the probe being determined to be moving, determine either oneor both of a moving direction and a speed of the probe.
 10. Thenon-transitory computer-readable medium of claim 8, wherein theinstructions are further executable by the processor to cause theprocessor to: determine a similarity between the generated plurality ofultrasound images; and determine the motion of the probe, based on thedetermined similarity.
 11. The non-transitory computer-readable mediumof claim 8, wherein the instructions are further executable by theprocessor to cause the processor to: based on the motion of the probebeing determined to correspond to the unfreezing function, control thedisplay to display a new ultrasound image that is generated by theprocessor; and based on the motion of the probe being determined tocorrespond to the freezing function, control the display to freeze thedisplayed ultrasound image; and based on the motion of the probe beingdetermined to correspond to the saving function, save, in the memory,the displayed ultrasound image.
 12. The non-transitory computer-readablemedium of claim 8, wherein the saving function is determined based on apushing motion of the probe, and wherein the unfreezing function isdetermined based on a moving motion, during a state in which theultrasound image is frozen.
 13. The non-transitory computer-readablemedium of claim 8, wherein the instructions are further executable bythe processor to cause the processor to control the display to displaymeasurement information of the frozen ultrasound image, on the frozenultrasound image.
 14. The non-transitory computer-readable medium ofclaim 8, wherein the instructions are further executable by theprocessor to cause the processor to: detect a number of input signalsduring a time unit; and perform a second function, based on the numberof input signals during the detected time unit.
 15. A method of anultrasound diagnostic apparatus, the method comprising: controlling adisplay to display an ultrasound image; determining a motion of a probe,based on changes across a plurality of ultrasound images, based on theultrasound signals; and performing a first function corresponding to themotion of the probe that is determined, and a diagnostic state, from aplurality of functions that are provided by the ultrasound diagnosticapparatus, based on mapping information that maps a plurality of motionsof the probe and a plurality of diagnostic states to the plurality offunctions, wherein the mapping information is pre-stored in a memory,wherein the plurality motions of the probe comprises any combination ofpushing, shaking, staying, moving, and turning, wherein the plurality ofdiagnostic states comprises any combination of detection of ROI, displayof ROI, measurement of ROI, screen freezing, display of diagnostic ormeasurement information, and image scanning, and wherein the pluralityof functions comprises any combination of a freezing function forfreezing the ultrasound image that is displayed, an unfreezing functionfor unfreezing the ultrasound image that is frozen, and a savingfunction for saving the ultrasound image that is displayed.
 16. Themethod of claim 15 further comprising: determining a similarity betweenthe generated plurality of ultrasound images; and determining the motionof the probe, based on the determined similarity.